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Abstract 


Optimal control of systems governed by functional differential 
equations of retarded and neutral type is considered. Problems with func- 
tion space initial and terminal manifolds are investigated. Existence of 
optimal controls, regularity, and bang-bang properties are discussed. 
Necessary and sufficient conditions are derived and several solved examples 
which illustrate the theory are presented. 
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Section 1 . Introduction , 

A large number of papers have been written on the control of func- 
tional differential equations to target sets in R n (for partial biblio- 
graphies see [4, 5, 44]). In this paper we treat a number of aspects con- 
cerning control to targets in function space. To the authors* knowledge 
only in the recent investigations reported in [36, 38, 39 > 4 9, 54] have 

others reported results for such problems. Popov [49] an< 3 Weiss [54] in- 
vestigate controllability while the work of Jacobs and Kao [36, 38] concerns 
necessary and sufficient conditions for retarded systems. As is pointed 
out in Section 5 below, their methods are quite different from those employed 
here. We treat control problems involving a fairly general class of neutral 
functional differential systems} a class which includes as special cases 
almost all nonlinear retarded systems that are of interest. Control of 
neutral systems in a somewhat different formulation has been investigated 
by Kamenskii and Khvilon [37] who use the methods of Pontryagin, et. al. 

[48] to derive necessary conditions for problems with targets sets in R n . 

In Section 5 we utilize the methods of Neustadt [46, 47] and Gamkrelidze 
[21] to obtain necessary conditions for the general nonlinear problem for- 
mulated in Section 2. We also show there that under certain convexity as- 
sumptions these conditions are sufficient for normal problems with linear- 
in-the- state systems. 

In addition to the problem formulation. Section 2 also contains 
a motivating example which shows that boundary control problems for certain 
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hyperbolic systems can be transformed to problems involving control of 
neutral functional differential equations to function space targets. Sec- 
tion 3 contains some of the theory (existence, representation, etc.) of 
neutral systems which has been developed, for the formulation used in this 
paper, mainly by Hale and his students and colleagues [24„ 25, 26, 30]. In 
Section 4 we present existence results for a large class of linear-in- the- 
state control problems. The related questions of smoothness (regularity) 
of controls and bang-bang properties (or lack thereof) are discussed. The 
paper is concluded with a section containing two solved examples along 
with comments concerning methods for solving examples via problem reformula- 
tion. More general necessary conditions plus a number of other solved 
examples may be found in the thesis of Kent [ 39 » see also 40] on which much 
of the work reported here is based. 

The following notational conventions will be adopted throughout 
the paper. We denote by ^ n [a,b] the space C([a,b],R n ) of Revalued 
continuous functions with the usual sup topology and by L^[a,b] the usual 
spaces of functions f (equivalence classes) with | f | P integrable in 
the sense of Lebesgue. We shall not use different symbols for various norms 
but let | »| represent the norm in whatever space may be appropriate. For 
example, if x e jgf n [a,b], | x| is the sup norm of x while [x(t)| repre- 
sents the R n norm of x(t). The symbol £ will denote the vector 

space of n x p real matrices and Ep will be used for the identity in 

the space £ . BV[a,b] will represent the space of functions of bounded 

pxp 
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variation on [a,b] with norm | g| = Var([a,b]jg) + |g(b)| where 

Var([a,b]jg) is the total variation of g on [a,b]. 

If xi [a-h,b] -» R n ; for t e [a,b] we denote by x^ the elements 

of S£ n [- h,0] given by x^e) = x(t+0), 0 e [-h,0]. For systems involving 

hereditary dependence we shall use the notation f(x(*),t) to mean that 

fs ^ n [tQ-h,t^] x [t , t ] -* R n may depend on any or all of the values 

x(s), t Q -h < s < t, where t e [t ,t^]. Examples of such dependence are 

f(x(.),t) = G(x(t),x(t-h),t), f(x(-),t) = G(x t ,t), f(x(«),t) = 
t 

/ a( t, s)G(x( s), t)ds (see [2, 2k]). 

V* 

Unless it is otherwise explicitly stated, all statements involving 
the concept of meausre will be interpreted with respect to Lebesgue measure. 
All integrals will be Lebesgue or Lebesgue - Stielt jes integrals [15], 

Finally we shall never distinguish between a vector and its transpose since 
in any vector-matrix operations it will be clear what is meant. 
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Section 2. Problem Formulation . 

Let J/q, be given subsets of 5f n [-h f O] and suppose U is 


specified non-empty subset of R. Define ^ = {u: [t ,t^] -» R | u is bounded, 
measurable with u(t) e U for t e [t^jt^]}. We shall consider the general 


problem of minimizing J = / f (x(t), u(t),t)dt subject to 

*0 - 


( 2 . 1 ) 


— D(x(-),t) = f(x(.),u(t),t) t € [t n ,t n ] 


0 * 1 J 


x e x e 

*o 0 t i 1 


U € ^ 


where the function D is defined by 


( 2 . 2 ) 


D(x(*),t) = x(t) - 


/ d u(t,s)x(s) 

V h 


With p £ 0 and the hypotheses specified in Section 3 below, the system 
(2.1) is a functional differential equation (FDE) of neutral type. If 
p = 0, the system is an FDE of retarded type. Simple examples of the type 
under consideration here are the differential difference equations 


(2.3) 


x(t) - A(t)x(t-h) = B(t)x(t) + C(t)x(t-h) + k(u(t),t) 


and 


(2.4) 


x(t) = B(t)x(t) + C(t)x(t-h) + k(u(t),t). 
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Many of the results obtained below can be extended to include cer- 
tain types of systems involving a hereditary dependence on the control u 
in addition to the state x (see Kent [39]) tut we shall not pursue that 
aspect of the problem in this paper. 

There are a number of physical situations which motivate the prob- 
lem as formulated above, although we shall cite only two of these here. Per- 
haps the simplest example where one desires to specify a terminal target 
in j^f-hjO] involves systems such as (2.3), (2.4). It has been recognized 
for many years that the true "state" for such systems is x^, not x(t). If 
x(t) represents some error which one wishes to be driven to zero (and held 
there if possible) and if the error is described by (2.3) or (2.4), then it 
is obvious that the desired terminal condition is x = 0. 

A second motivational example which we shall only sketch here 
(see [39] for discussion of a similar example) involves boundary control of 
linear hyperbolic partial differential equations. Suppose we are given the 
wave equation for w(t,x) 

(2.5) w tt - c^ = 0 t e [0,T], x e [0,1] 

with boundary conditions 

A Q (t)w t (t,0) + B Q (t)w x (t,0) = ^(t,w(t,0)) 

A 1 ( t ) w t (t,l) + B 1 (t)w x (t,l) = g x (t,w(t,l)) 


( 2 . 6 ) 
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and initial-terminal conditions 


( 2 . 7 ) 


w(0,x) = a Q (x) w t (o,x) = OjU) 

w(T,x) = p Q (x) w t (T,x) = P^x). 


Suppose that A., B. are continuously differentiable, are absolutely 

continuous in t, continuously differentiable in w with g.^ being do- 
minated by L 2 functions, i = 1,2. In addition assume that a’, a^, 
are absolutely continuous with Lg derivatives (* = — ) . Under the ad- 
ditional hypotheses A (t) - — B (t) / 0, A..(t) + — B (t) / 0 for t e 
[0,T], one can derive an equivalent neutral system in the following way. 
Assume a solution of the form (D* Alambert) 


w(t,x) = <p(t + |) + Y(t - J). 


Upon substitution in (2.6), followed by differentiation with respect to t 
and a few algebraic manipulations, one obtains a neutral system in (cp , ,i|/' ) 
(y, z) of the form 


( 2 . 8 ) 


y(t) + R(t)z(t - §) = H 1 (t,y(-),z(*)) 

z(t) + S(t)z(t - |) = Hg(t,y( • ), z( * ) ) . 


The data given in (2.7) can be used to produce initial and terminal data 
in terms of (y, z) for the system (2.8). Appropriate assumptions on the 
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boundary terms ^g^ (which contain the controls for the problem) lead to 

a controlled system involving (2.8) for t e [^,T] with initial and terminal 

values of y specified on [0,-^] and at t = T and corresponding values 

11 2 

of z given on [ - — , — ] and [T- — ,T]. The terms Hp H 2 are such that 
this initial data is sufficient to solve (2.8) for absolutely continuous 
(<p',r ) having Lg derivatives. It is not difficult to argue that this 
(cp,i|/) used in the D’Alambert solution above yields a solution to the ori- 
ginal equation (2.5) in the (non-classical) sense that w(t,x) = cp(t+ — ) + 

X 

ty(t - — ) is continuously differentiable with w , w being absolutely 
continuous and possessing L 2 partials satisfying (2.5) a.e. 

The boundary conditions (2.6) include as special cases the usual 
boundary conditions [13, lk, 53] associated with (2.5) for transverse vibra- 
tions of a string or longitudinal vibrations in an elastic rod with elasti- 
cally supported ends. 

Other authors have pointed out connections between the study of 
hyperbolic systems and neutral IDE's. Brayton [9] and'Slemrod [52] were con- 
cerned with systems arising from the study of lossless transmission lines 
while Cooke and Krumme [12] discussed a general method for reducing linear 
hyperbolic systems with nonlinear initial-boundary conditions to functional 
differential systems of neutral type. 
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S ection 5 . Representation Results for Linear Neutral Systems . 

In this section we shall present properties of solutions of neutral 

systems which will he needed in the ensuing discussions. Our main results 

pertain to the variation of parameters representation for solutions to 

general linear systems. Referring to the function D defined in (2.2), we 

2 

make the following standing assumptions on pi R . 

p(a,0) = 0 for 0 > a, p(a,0) = p(a,t Q -h) for 0 < t Q -h; p is 

Borel measurable, continuous from the right in its first argument 

and continuous from the left in its second argument; 0 ->p(o,0) is 

of bounded variation on every finite 0 interval, uniformly in CT; 

t 

and the mapping t ->r(cp,t) = / d p(t, s)cp(s) is continuous on 

V s 

[t ,t^ for each fixed cp e g [t Q -h,t 1 ], which obviously implies 
that (cp,t) ->r(cp,t) is continuous. 

($.2) there is a continuous non-decreasing function 6 with 6(o) = 0 such 
that for each t e R"*" and 6 >0 we have Var([t-6,t]; p(t,-)) < 

6(e). 

Specific conditions on p directly for which the last hypothesis 
in (5.1) obtains have been given by Kent [59]. Included as a special case 
of these is the situation where p(s, 0) = ^/(s, 0) + _Qf(s,0), 0 -» ^f(s , 0) 
being a "well-behaved" jump function and 0 -»_Q^(s ,0) representing the ab- 
solutely continuous part of 0 -»p(s,0). We shall not present the exact 
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technical assumptions on } _q/ here, but refer the interested reader to 
[39]. It suffices to remark that systems encountered in applications almost 
always satisfy these conditions. 

We next consider solutions to 


^D(x(-),t) = / d g T!(t,s)x(s) + g(t) t e [t^tj 


( 3 . 3 ) 


v h 


x = cp, 
t 0 


where by a solution x we shall mean an x e ,^ n [t -h,t ] such that t -> 

D(x(*),t) is absolutely continuous on [t^t^] with (3. 3) being satisfied 

a.e. The non- homogeneous term gi [t ,t^] -> R n will always satisfy g e L-^ 

2 

and we make the following hypotheses on rj: R 


(3. *0 1(0, &) = 0 for 0 > a, T](a,0) = T](a,t Q -h) for 0 < t Q -h; t] is 

measurable, continuous from the left in its second variable on 

(-°°,a); 0 -» T)(a, 0) is of bounded variation on every finite 0 inter 

loc 

val and there is an me such that Var([t 0 -h, a]; t)(o, • ) ) < m(cr) 


Under the above hypotheses and Caratheordory type assumptions on 

f, one can prove the usual local existence and continuation theorems for 

solutions to (2.1) with x = cp, cp e ^ n [-h,0]. In addition one can es- 

t 0 

tablish that (3.3) possesses a unique solution [25, 2 6 , 30, 39]. We turn 
next to the "adjoint" system to (3.3) with g = 0. 
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Theorem 3. 1 . Under the assumptions (3.1), (3.2), (3.^), for each fixed t e 
[t.jt^] the system 

t + t 

Y(s,t) = E n + / d a Y(a,t)ji(a, s) - / Y(a, t) t](q:, s)da s e [t Q ,t) 

(3.5) 

Y(t,t) = E , Y(s,t) =0 for s > t 

has a unique solution on [t ,t ]. Tllis solution Y(s,t) e ^nxn is le ^ t “ 
continuous in its first argument and | Y( s, t) | < Var([t () ,t 1 ]|Y(*,t)) <@ 

for ( s, t) e x [tg,t ] where & is finite and independent of (s,t). 

Proof ; We assume for ease in notation (and without loss of generality) that 
t Q = 0. The proof of existence of a unique solution and left continuity in 
its first argument is due to Henry [30]. We shall here only sketch the argu- 
ments, indicating how one obtains the bound & . We note that it suffices 
to prove the uniform bound on the variation of Y(*,t) since for s e [tQ,t^] 

Var([t 0 ,t 1 ];Y(-,t)) > | Y(t Q ,t)-Y(s,t)| + | Y( s,t) -Y( t^ t) | 
>|Y(s,t)| - |Y(t x ,t)| > | Y( s, t) ( - |Ej. 

In the proof sketched here, one actually obtains existence of the 
solution to (3.5) on | s| < tp 1 1| < t^ Let G > 0 be chosen sufficiently 


small so that 



11 


t 

(3.6) 6 ( 6 ) + / m(0)d0 < X < 1 

t-e 

for all | t| < 2t , where 8 is the function guaranteed in (3»2). We make 
the induction hypotheses (clearly true for p = 0 ) that for j t| < t the 
solution Y(s,t) of (3«5) exists for s e [t-pS,t^] and satisfies 
Var([t-pe,t^]jY(*,t)) < K where is independent of t. We then define 

successive approximants by 


f Y(s,t) 

\ Y(t-pe,t) 


s e (t-pe,t 1 l 
s e [-t^t-pe] 


and 


Y k (s,t) 


Y(s,t) s e (t-pG,t 1 ] 

t + t 

E n + / d i (a,t)n(a,s)-/ Y (a,t)T](a,s)da 

s s 

s e [-tpt-pe] 


for k = 1,2,... . Using ( 3 . 6 ) and these definitions along with the 
hypotheses in ( 3 . 2 ), (3.4), one can easily show that 


||Y k+ 1 (.,t) - Y k (*,t)|| < Xl|Y k (*,t) - Y k_ 1 (-,t)|| 


and hence 
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||y k+ 1 (-,t) - Y k (-,t)|] < X k ||T 1 C,t) - Y°(*,t)|| 


where || g|j = Var([t-(p+l)£,t-pe];g). Observing that one actually has 

k. k 

Y (s,t) = Y(s,t) for s e [t-p£,t^], one sees that Y (°,t) converges 

in BV[t-(p+l)£,t-p£] to a function Y(*,t). Letting k -» « in the above 

approximants we see that this extends the solution from [t-pS^t^] to 

[t-(p+l)£,t^] o A finite number of induction steps on p yields existence 

as claimed. The left continuity and uniqueness follow directly from the 

hypotheses on p.,T] and the equation for Y« 

Returning to the arguments involving Y k (*,t), we have that 


||Y k (-,t)|| < ||Y k (-,t)-Y k " 1 (-,t)|| + ||Y k_1 (%t)|| ■ 

< {X k ' 1 +X k ' 2 +...+\ 1 +l}||Y 1 (",t)-Y°(-,t)|| + ||Y°(-,t)|| 
<I7x l|Y 1 (*,t)-Y°(*,t)|| + || Y°( • ,t)|| . 


But || Y°( 0 , t ) || = 0 and using elementary arguments with the hypotheses on 
the definitions of Y°,Y 1 , one can easily show that 


|y x ( 


>*) 


■Y°( 




< K {M + 

- P 


t-pE 


2 / 

t-(p+i)e 


m(0)d0} 


for 1 1| < t^« It follows that 


l|Y k (*,t)|| < B p 
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where is independent of t, 1 1| < t^. Since ||y^( 0 ,t)-Y( * ,t)|| -»0, 

we obtain ||Y(°,t)|| < B . Thus 


Var([t-(p+l)e,t 1 ]sY(« J ,t)) <||l(*,t)|| + Var( [ t-pG ,tp] $Y( * , t) ) 


< B 

- P 


K = 
P 


K 


P+1 


where is independent of t, |t| < tp. The finite number of induc- 

tion steps on p then produce the bound & independent of t. 

Theorem 3.2 . Let x be the solution of (3.3) under the assumptions (3.1), 
(3.2), (3.4). Then for t e [t^tp] 


(3.7) 


x(t) = Y(t t)D(cp,t ) + / d y(t,p)cp(P) 
u u t-'-h p 

t u 

+ / Y(p,t)g(p)dp 

t 0 


where Y is given by (3.5) and 


t + t 

r(t,p) = -/ d Y(a,t)|i(a,p) + / Y(a,t)rj(a,p)da. 

*0 *0 

The proof of this theorem is due to Henry [30]. We shall omit it 
here since it involves a standard type of argument making use of integration 
by parts, an unsymmetric Fubini theorem [10], and the equation for Y. We 
note that for n = 0 the adjoint system (3.5) and the representation (3.7) 
reduce to that for retarded systems [2 f 3]. 
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Remark 3. 1 . We make some further comments about the solution Y of (5*5) 
which may correctly be regarded as a "fundamental matrix solution". It is 
not difficult to show [ 39l that for fixed s, the function t -»Y(s,t) (which 
is, in general, discontinuous) is BV and satisfies 

t t p 

Y(s,t) = E n + / d p(t,0)Y(s,0) + / dp / d 0 i)(p,0)Y(s,0) 
s s s 

for t > s, with Y(s,t) = 0 for t < s. Note that this is just the 
integrated form of (3.3) with g = 0. In a subsequent section (Section 5) 
of this paper, it will be essential that the mapping (s,t) -*Y(s,t) be 
Borel measurable. (This is needed in order to use Y as the measure in 
the unsymmetric Fubini theorem [10].) This will be true under varied assump- 
tions on p. For example, Kent [39l has shown that it is sufficient that 
t ->p(t,0) be of bounded variation on each finite t interval for each 
fixed 0. Henry [30] has established Borel measurability of Y under 
other assumptions. Since we do not wish to become involved in these techni- 
cal details here and since any system of interest to us in this paper would 
meet either Kent’ s or Henry’ s assumptions, we make the standing hypothesis 
that (s,t) -»Y(s,t) is Borel measurable. 

Before presenting the final results of this section we must make 
the following definition. For $ C ^ n [-h,0], K e L^t , t^] and X C R n , 
define C([t Q -h, t-^Xj^K) C if^-h,^] by C([t () -h,t 1 ],X|®,K) = 

(x e < ^ n [t () -h,t 1 ]jx t e ®, x(t) e X for t e [t Q -h,t 1 ], | ^ D(x( • ),t) | < K(t) 
a.e. t e [t^t^]. 
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Theorem 3.3 . In addition to (3.1), (3-2), assume that p satisfies 
there exist i > 0, L > 0 such that for s < t 

(3.8) t 

/ I d (M.(t,e)-iu(s,e)}| < l| t-s| . 
t-i 9 

Then X, $ compact implies C([t Q -h,t 1 ],X;$,K) is a compact subset of 
$£ n [tQ-h,t ]. It is also convex if X, ® are. 

Proof : Convexity follows from the linearity of D(x(*),t) = x(t) - r(x,t). 

For any cp e we define x^ by x^t) = q>(t-t Q ), t e [t 0 -h,t Q ], x fp (t) = 

cp(o), t > t Q . Then for x e C([t 0 -h,t 1 ],X;$,K) with x^ = cp we have 

|x(t)-x(t Q )| < |D(x(.),t)-D(x(.),t 0 )| + |r(x,t)-r(^,t)| 

+ l r (V t) " r(X 9 ,t 0 ) l 

t t 

</ K(s)ds + |/ d 0 n(t,0)(x(0)-x(t o ))| 
t 0 *0 

+ i^v^vVi* 

Choosing p such that 0 < p < i and 5(p) < 1, we thus find for t e 

[ W pl 

t 

I x(-b) -x(t Q ) I </ K(s)ds + 6(p)||x-x cp || t 
t 0 

+ sup{| r(x^t)-r(x^t 0 )| : t e [t Q ,t 0 +p], \|r e $} 



l6 


where ||x|| = sup(|x(s)| • s e [t Q -h,t]}. But since the right side of this 

expression is non-decreasing in t, we obtain 


i^V't ^ 


K(s)ds + 6(p)||x-x 


cp t 


+ sup |r(x t)-r( x t Q )| 

t,i 


or 


x-x 


V't 


< b|/ K(s)ds + sup |T(x t)-r(x t )|[ = R, 

(t Q M V ? » 

where b = l/(l-6(p)), 


We remark that the sup term is finite since T is continuous, $ is compact. 
For t Q < t < t < t Q +p we therefore have 

I x( t) -x( t) | < |D(x(.),t)-D(x(.),T)| + I r(x,t)-r(x,T)| 
t 

< / K(s)ds + |r(x q) ,t)-r(x^T)| 

t 

+ 1/ <a s [p(t,s)-p(T,s)]{x(s)- Xcp (s)}| 
t to w 

< / K(s)ds + sup{ | r( x^, t) ~r( t ) | : *r e ®) 

+ L|t-T|R. 


From the continuity of T and the compactness of it follows that the 
elements of C([t 0 -h,t 1 ],X;$,K) form an equicontinuous family on [t Q -h, t Q +p]. 
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Since the restrictions of these elements to [t^-h^t^+p] constitute a bounded 
subset of , use of the Arzela-Ascoli theorem here, followed 

by repetition of the above arguments on [ t Q +p, t Q +2p] , [ t Q +2p,t 0 +3p] , . . . (for 
a finite number of steps), leads to the conclusion that C([tQ-h,t^] ,Xj<l>,K) 
is a conditionally compact subset of . Using the compactness 

of X,<I> and the continuity of D, it is not difficult to argue that 
C([t^-h,t^],X;<I>,K) is a closed, hence compact, subset of if^t -h,t ]. 
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Section 4 . Existence, Regularity and Bang-Bang Results. 

We shall consider first systems that are linear in the state, i.e., 
system (3-3) with g(t) = k(u(t),t). We shall approach the questions of 
existence, smoothness of controls and bang-bang properties by considering 
attainable sets in ^ n [-h,0]. We assume 

(4.1) the mapping k: R m X R 1 -» R n is continuous, the set U C R m is com- 
pact, and k(U,t) = (k(u,t)|u e U} is convex for each t. 

Define the family by (f: 5f\ t Q -l>, t^ X [t^t^ R n | f (x.( • ),t) = 

t 

/ d T)(t, s)x(s) + k(u(t),t), u e where ^ is the class of admissible 

v h 

controls as defined in Section 2. We are thus considering 

~D(x(*), t ) = f(x(.),t) t e [t^t^ 



for (cp, f) e $ x 3 1 . We assume of course throughout that p, t] satisfy 
conditions (3.1), (3.2), (3.4). Recalling that ||y|| t = s up{|y(s)| * s e 
[t Q -h,t]} we then have 

Lemma 4.1 . In addition to the above hypotheses, assume ® is a bounded 
subset of ^ n [-h,0]. Then there is an M >0 such that ||x(cp, f)|| <M 
for t e [t ,t^], (cp, f) e $ X _^ r , where x(cp,f) denotes the solution to 
(4.2) for (cp, f ) € ® x 3^. 
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Proof : It is easy to see that there is a constant 

m such that |f(x(*),t)| < m(t)[||x||. t +d] for every 
X = x(cp,f), (M) e ® X we have 


d 


f 


and an function 

e J**. Letting 


Choosing p such 
t € [-t 0 ,t 0 +p] 


t 

x(t) = x(t ) + / d u(t,s)x(s) 

*0 

t t 

* ! 0 -u(t s) ]x( s) + / f(x(.),s)ds. 

V h *0 

0 < 8(p) < 1 and letting b = l/(l-S(p)), we find for 


t^ 

||x|| t < |cp| + S(p)||xjj t + 25 (t 1 -t 0 +h)|<p| + / S(s)[||x|| s 4d]ds. 

t 0 


It follows that 


d + ||x|| t <b J[l+25(t 1 -t () +h)][|cp| +d] + / m(s)[||x|| s +d]ds 
' t 0 

and applying Gronwall’ s inequality, we find that for t e [t^t^+p] 

~ ^ t^ 

d + ||x|j t < b{l+28(t 1 -t 0 +h)}{d+| cp| }exp[b / m(s)ds]. 

Repetition of the above arguments on [ t Q +p,t o +2p], . . .,[t Q +(N-l)p,t 1 ] 
yields 

d + IMI t < b W {l+28(t 1 -t 0 +h)} N {d+|cp| }exp[b / 1 m(s)ds]. 

1 t 0 
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The result then follows from the fact that $ is bounded. 

Lemma 4.2 . Under the assumptions (3.1), (3.2), (3**0, (3.8) and (4.1), $ 
compact in ^ n [-h,0] implies jaf = {x(cp, f ) j (cp, f ) e $ x JF] is an equicon- 
tinuous subset of ^ n [ t^-h, t^] . 

j 

Proof: From Lemma 4.1 it follows that for any x e ^ D(x(*),t) < 

m(t)[||x||^+d] < m(t)[M+d] = K(t) on [t^t^] where K e L^. The same lemma 
guarantees existence of a compact X C R n such that x(t) e X, t e 
[t Q -h,t^], x € -Q^. Thus is a subset of C([t^-h,t 1 ],X;0, K) which, by 
Lemma 3.3, is a compact subset of ^ n [t^-h, t^] . The equicontinuity of Q& 
thus follows from a well-known theorem [15, p. 266], 

We define, for each t 6 [t^q], the attainable set at time t 

given by 

ja/ t ($,^’) = {z € $? n [- h,0]|z = x t (cp, f), (cp,f) e d> x^}. 

Using the representation results given in Theorem 3.2 for the solutions 
x ( c P^f)^ we can write 

-a^ t (*,^) = ^ t ($,o) + ^(O/fr) 


where 
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^ t (®,0) =jy t e ^ n [-h,0]|y(s) - Y(t 0 ,s)D(q>,t 0 ) 
t~ 

+ / ° d r(s,p)cpO) for s > t , y(s) = cp(s-t ) 

V h 

for s e [t 0 -h,t Q ], cp e « J 

and 

i s 

sjy t e ^ n [-h,0]| y(s) = / Y(P, s)k(u(p),p)dp for 

s > t Q , y(s) =0 for s e [t Q -h,t 0 ], u 

We note that -^.(®,0) consists of restrictions of solutions to (5.3) with 
g = 0 and initial data cp e <5 while <^.(0,^) is the set of restrictions 
of solutions to (3.3) with g(t) = k(u(t),t), u e and initial data 
cp = 0. 

For fixed t € (t , t^], let us first consider the set ^.(0, *%) . 
We define the set _5^( %) and the mapping T^: L^ft^t^] -»^ n [-h,0] by 

-^'( < 2r) = (g e L 1 C t 0 ,t 1 ]| g(s) = k(u(s),s), u e<%] 

and 

t+e 

/ Y(p,t+e) g (p)dp t+e > t Q 

T^gXS) = ° 

t+e < t Q 


0 
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for 6 e [-h,0], so that 0 ,°k) = T^Ci^t^))* 

Lemma 4.3 . Under the assumptions (4.1), ^^.(0, < 2f) is a closed subset of 
& n [-h,0]. 

Proof : The ideas in this proof are by now quite familiar to control theorists 

[ 32 , p. 18-23$ 11, 17, 31) • First, from arguments similar to Filippov's [19], 

it follows easily that is a weakly sequentially closed subset of 

L^[t ,t-^]. From the hypotheses (4.1) one obtains [15, p. 292] that 

is weakly sequentially compact in L^[t ,t^] and hence by Eberlein-Smulian 

[15, p. 430] the weak closure of J^(^r) is weakly compact. But the weak 

closure of J^(^) is the same as its weak sequential closure [15, p. 434]. 

Hence is a weakly compact subset of L^t^t.^. 

"fc 

The map T is clearly continuous with respect to the strong 
topologies of L-^ and ^ n [-h,0], and hence continuous with respect to 
the weak topologies on these spaces [ 15, p. 422], It follows that 
is weakly compact and hence weakly [a fortiori strongly] closed in ^ n [-h,0]. 

Remark 4.1 . The conditions (4.1) under which Lemma 4.3 obtains can be re- 
laxed. Using arguments similar to those of Jacobs [35, p. 4l6] one can 
show that is weakly sequentially closed under the assumptions: 

t — >U(t) defines an upper semicontinuous mapping with range in the collec- 
tion of non-empty compact subsets of R m ; k(U(t),t) is convex for each 
t e [t ,t^]$ and u -»k(u,t) is continuous for each t, t ->k(u,t) is 
measurable and there is an me L^ such that |k(u,t)j < m(t), u e U(t). 
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The other arguments in the proof of Lemma 4.3 then hold without change. Com- 
ments on relaxing the convexity assumptions will be made below. 

Under the assumptions of Lemma 4.2, we see that 3^.(0,^) is an 
equicontinuous subset of ^ n [-h,0]. Since it is also bounded, the Arzela- 
Ascoli theorem implies that & ^ 0 ,%) is conditionally compact. Lemma 4.3 
then yields the compactness of 3^(0, < 2?). 

Next let us consider 0). For $ compact in ^ n [-h,0], 

to show & .($,0) compact in ^ n [-h,0] it suffices to show that the map- 

"G 

ping cp -» y (cp) is continuous, where y is as given in the definition of 
^ t (®,0). Clearly, it is enough to demonstrate that for t > t Q +h the map- 
ping cp -> z^(cp) e _^’ n [-h,0] is continuous, where 

t” 

z t (cp)(e) = Y(t o ,t+0)D(cp,t o ) + / d p T<t + 0,p)cp(P) 0 £ [ -h,0] . 

t Q -h 

We have 


I z (cp)-z (x|/)| < sup | Y(t ,t+0)| |D(cp,t )-D(\|r,t 0 )| 
t Z 0e[-h,O] U 0 0 

+ sup | / 0 d r(t+0,p)[cp(p)-i(p)]| 

0e[-h,O] t Q -h p 

< SU P |Y(t 0 ,t+e)||D(<p,t 0 )-DU,t 0 )| 

G 

+ sup Var([t o -h,t o ];r(t+0,.))|cp- 1 l'| . 

0 

From the continuity of D, it suffices to show that the sup terms are finite. 
Using the definition of y and the hypotheses (3.1), (3.4) on pi, tj, one can 
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show easily that for 9 e [-h, 0] 

t+0 + 

Var([t 0 -h,t 0 ];r(t+e,-)) < m 1 / |d a Y(o,t+e)| 

t o 

t+e 

+ / | Y(a,t+0)| m(a)da:. 

*0 

The bounds guaranteed in Theorem 3.1 then imply that the sup terms are in- 
deed finite. 

Theorem 4.1 . Under the assumptions (3.1), (3.2), (3.4), (3.8), and (4.1), G> 
compact in h,0] implies _a^ t (S>,.5 z ') is compact in _^ n [-h,0], t e 

[t.,t 1 ]. Furthermore, the mapping t -» -Q^,(®,-^) is continuous with respect 
to the Hausdorff metric [7]. 

Proof* The first conclusion of the theorem is evident from the compactness 
of & ($, 0 ) and & (0 ,'<&'). The second assertion follows easily from the 
fact (Lemma 4.2) that t -»x^.(cp,f) is continuous uniformly in (<P, f ) e $ x 2^ 

Remark 4.2 . The continuity of t -»J3^(4,^ r ) can be proved for retarded 
systems (p = 0) by the usual arguments ([42* p. 70-71], [45; p. Il4]) in- 
volving the variation of parameters representation (Theorem 3.2). These argu- 
ments depend very much on the continuity of t -»Y(a,t). For neutral systems, 
this continuity requirement is not met and hence a direct extension of the 
usual arguments is not possible. The compactness arguments can also be 
made somewhat more directly for the retarded case by taking advantage of the 
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continuity of t -»Y(a,t). 

The results given in Theorem 4.1 are sufficient to obtain existence 
theorems for a wide class of linear-in-the-state problems with initial and 

J 

terminal manifolds in 5f n [-h f 0], Since the proofs involve well-known argu- 
ments [ 52 , 42, 45], we shall only list a few of these problems here, (in each 
case it is assumed that S = $ is compact and S^ is closed.) 

(i) The time -optimal problem for hitting a target set S C 

_^ n [-h,0], starting from an initial manifold S^ = 4. (In 
the formulation of Section 2, take f° = 1 and t^ not fixed.) 

(ii) The problem of minimizing P(x ) subject to x e S. t 

"C "C . 1 

1 1 

i = 0,1, where P: ^ n [-h,0] -» R 1 is continuous. 

(iii) Minimization of J = / 1 {A°x(t)+k°( u(t),t)}dt subject to 

*0 

x e S. , i =0,1. (The usual device of augmenting the 
"t . 1 

1 

system and then minimizing P(x) = x (t^) allows a direct 
application of Theorem 4.1 here.) 

Various generalizations are possible, e.g. allowing the target S' to de- 
pend on time [4, 52, 42, 45]. We shall not pursue these matters in this 
paper since our main interest concerns problems with S^ f Sy each consist- 
ing of a single point in ^ n [-h,0]. 

Kent has shown that fairly general existence results such as those 
by Jacobs [55] can be extended to include systems described by certain non- 
linear neutral equations. Some of the arguments are tedious and we shall not 
present them here, but instead refer the reader to [59]. One type of nonlinear 
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existence result which we should mention here is needed for a complete dis- 
cussion of Example 6.2 below. Briefly, suppose that in the formulation in 

t 

Section 2, f of (2,1) has the form f(x( • ),u(t),t) = / d r)(t, s)x(s) 

v h 

+ B(t)u(t), f°(x(t),u(t),t) = x(t)Qx(t) + u(t)Ru(t) where Q > 0, R > 0 
and ^ = {cp ) , = {£} where <p, £ are given in ]^ n [-h,0]. Existence 

results for this problem follow from standard arguments [42] which we shall 
only sketch here. Letting {u } be chosen, u^ e ^ x n = 9, x n = £, so 

h to h 

that j(u Q ) = / x n Qx n + u M Ru n -» 6 = inf{ j(u)| u e <2f, x + (u) = cp, x + (u) = £}, 


n n 


n n 


Ck 


0 


'1 


one sees that f u Ru is bounded, and hence [u ) is bounded in L 0 [t^,t n ]. 

Inn 3 n 2 L O' 1 

0 

Choosing a weakly convergent subsequence [u }, it is not hard to argue that 

n k 

the corresponding trajectories [x } satisfy x (t) -» x (t), t e [t ,t ], 

n k n k 0 1 

•#* 

where x is the trajectory corresponding to u , the weak limit of [u }. 

n k 

Use of the weak lower- semi- continuity of u -* f uRu along with other well- 

known arguments yields j(u ) < p. If U = R m , then u e <2' ++ and the proof 

is completed. If U is compact convex in R m , then [15, p. 422] some se- 

quence of convex combinations of the u converges in L p [t ,t ] to u . 

* n k 0 1 

It follows that u (t) e U a. e. and again the proof is concluded. 


We turn next to the questions of regularity (smoothness) of con- 
trols and bang-bang properties (U is taken compact in R m ) . Many authors 

++ . * 

In this case we take % as ^[t^t^] and do not insist that u be 

pointwise bounded as required in the formulation of Section 2. 
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have investigated these questions for finite and certain types of infinite 
dimensional systems. An often considered question [l8, 27, 28, 29, 32, 42] 
is the following* Given a "state" that is attainable from a given initial 
"state" employing a measurable control, is it possible to attain the same 
"state" using a piecewise continuous bang-bang control? An affirmative 
answer to this question has been given by Banks and Jacobs [4] for some 
classes of retarded systems when the attainable "states" are taken in R n . 
The methods used are extensions of ideas due to Halkin and Hendricks 
[27, 28, 29]. The results in [4] can be extended to include certain types 
of neutral systems (for example, (2.3) above when A, B, C are analytic). 
However, our interest here is in attainable "states" in <^ n [-h,0]. Since 
it is known that there is no infinite dimensional analogue of the 
Liapunov theorem which is the basis of the above arguments [27, 28, 29], 
we face considerable difficulties. In fact, in light of known results for 
linear ODE systems [ see 32, p. Ill] concerning bang-bang results for tra- 
jectories (attainable "states" in 3^ n [-h,0] correspond to terminal seg- 
ments of trajectories: x(s), s e [t^-h, t^]) one might suspect that the best 
that can be obtained is a density theorem. But what if one is willing to 
make assumptions on the EDE (such as A or C non-singular in (2.3) or 
(2.4)) so that ODE's are not special cases of the EDE? The authors did 
this for retarded systems, using the methods of Hale [23] involving a 
finite dimensional projection argument (for which the Liapunov type re- 
sults are valid). Certain results on eigenfunction expansions of solu- 
tions to EDE' s [6] were also needed since a limiting process in a space 
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of closed subsets of ]^ n [-h,0] was employed. This lead only to the den- 
sity theorem one would certainly expect to be true. The following examples 
demonstrate the futility of our efforts. 

Example 4.1 . Consider the retarded system 

x(t) = x(t-l) + u(t) t e [0,3] 

with U = [v e R" 1 : | v| <1} and £(t) = (3-t), t e [2,3]. It is not hard 

to show that £ can be attained by a measurable control u with u(t) e U, 
starting from the initial function cp(t) = -t, t e [-1,0]. But £ is not 
attainable with a bang-bang control from any initial cp. Suppose it were, 
with the bang-bang control denoted by u°. Since x(t) = - — for t e [2,3] 

and |u°(t)| = 1, we see from the equation that | - -i - x(t-l)| =1 or 

x(t-l) = i, t e [2,3]. This implies x(t) = -i and £(t) = 0 for t e [1,2]. 
But then 0 = x(t-l) + u°(t), t e [1,2] and [u°(t)| = 1 impli es | x(t-l) | = 1, 
t e [1,2] or |x(t)| = 1, t e [0,1], contradicting the fact that x(l) = 

Example 4.2 . Consider the neutral system 

x(t) = x(t-l) + u(t) t e [0,2] 

with U as in the previous example and £(t) = 2-t, t e [1,2], The as- 
sumption that u is bang-bang and £ is attained leads easily to the con- 
clusion that | cp( -b) | =1 or cp(t) = -3 where cp is the initial function. 

But it is easy to demonstrate that there are initial functions cp (e.g. 
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q>( -t ) = 1) with |<p(t)| / 1, cp(t) jt -3, and admissible controls u such that 

t, is attainable from cp using u. Thus there are initial functions cp for 

which the attainable set in ^f n [- h,0] from 9 using bang-bang controls 

is a proper subset of the set attained using all admissible controls. 

The density theorem mentioned above can also be obtained under less 

restrictive assumptions as an easy application of a result due to Fattorini. 

For example, consider (3*3) with p = 0, $ = {9), g(t) = B(t)u(t), B e 
m m 

and define U = ir [-1,1], U = tt {-1,1} so that U consists of the 

• -1 0 • -1 € 

1=1 1=1 

vertices of the "cube" U. Let = {us [t ,t^] R m | u measurable, 

& 

u(t) e U} while ^ = {ul [t ,t ] -» R 11 ] u piecewise continuous, u(t) e U ]. 

0 1 6 

# n 

Then _q# ( 9 , ) are defined as subsets of [-h,0] in the 
usual way using the representation results of Section 3. It is not hard to 
argue that one could make use of Bochner integrals [33] in place of the 
Lebesgue integrals in defining ^), stf (9,^^) . Under the standing 

hypotheses of Section 3, it is then easy to verify that Lemma 1 of [ l8] 

M 

is applicable and thus stf, ($,^ # ) is dense in fy) in the norm of 

u X 

^ n [-h,0]. 

JL 

Remark 4.3. The examples above show that while stf, may be dense in 

it will in general be a proper subset of J3^.(9, < ^') and hence is 
not closed in ^ n [-h,0]. Referring to Remark 4.1, we see that one there- 
fore would not obtain the closure results of Lemma 4.3 if the convexity as- 
sumptions of (4.1) are relaxed. Note that this differs from the situation 



30 


for linear ODE and FDE systems where one can obtain existence results in 
the absence of convexity assumptions when the "state" is taken in R n 

[ 4 , 35 , 45 ]. 
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Section 3 » Necessary and Sufficient Conditions , 

In this section we shall first derive necessary conditions for the 
problem given in Section 2 with t , t^ fixed and = {cp}, = { £} 

where cp, £ are given in h,0], i.e., the fixed endpoint problem in 

control theory. Necessary conditions for problems with t variable (in- 
cluding the time optimal problem) and with more general manifolds 
have been given in [39* ^0]. Considering the problem as formulated in Sec- 

tion 2, we define f = (f ,f) and in addition to the standing hypotheses 

a 2^ n+1 

of Section 3 on 4 we assume: f: % [ t^-h, t^] x U X R I s 

continuously differentiable in x for each fixed (u,t) e U X [t^t^] and 

Borel measurable in (u, t) for each fixed x e ^f n [t 0 ~h, t^]. Furthermore, 

given any u e ^ and compact convex X C R n , there is an me L-Jt^t^] 

such that | f(x( • ),u(t),t)| < m(t), j df[x( • ),u(t),t; • ]| < m(t) for each 

x e CCft^-h, t^],X) and t e where df is the Frechet differential 

of f with respect to x (see [2, p. 1-2]). Defining x°(t) = 
t 

/ f (x( s), u( s), s)ds and x = (x ,x), we have the following necessary con- 

*0 

ditions that must be satisfied by solutions to the above problem. 

Theorem 3. 1 . Let (x ,u ) be optimal. Then there exist a <0, 
ty: l^q, 00 ) R } A.: R -» R with t. A, of bounded variation and left-con- 

tinuous such that 

(i) = ( A ’ n+ i-V X n+2"^***^2n"V where the $ = 1, • • •, 2n 

satisfy: X. is constant on \.(s) = 0 for s > 0, 

cl <J 
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X. is left -continuous and non-increasing with 


2n 

| a°| + Z Var( [ -h,0]; X.) >0; 

3=1 3 

o o o 

(ii) \|/ = (ty , ^) satisfies = a < 0 and 

0+ t t t i * 

i|/(s) = / dX(0) + / dil/(0)n(0,s) - / [i|/(0)rj (0,s)-a 

s-t^ s s 

s 

t( s) = 0 s > t x . 


where f° (0) = f°(x (0),u (0),0) and t) is such that 

X X 

df[x*(*),u*(t),t;y] = / d g T)*(t, s)y( s) for t e [t ^ 

V h 

,n r 


y € Sf [ t 0 - h # t 1 3; 


"t "fc 

( iii) I 1 i(s)f(x*('),u(s),s)ds < / 1 \j/( s)f(x*( * ), u*( s), s)ds 


^0 


0 


for all u e . 


Proof : Let & - ' = (x e ^ n+1 [ t Q -h, t^] | x°(t) = f°(x(t),u(t),t), 

|^D(x(-),t) = f(x(-),u(t),t), t e [t 0 ,t L ], for some u e and x t 

(0,9)}, = SfH-hjO], and Z Q = {y e <g Q \ y(0) < 0, 0 e [-.h,0]}. 

fine mappings 9 Q : & R 1 , 9_ i :j^-> ^ Qf i = -1,-2, . ..,-2n, by 9 Q (x) 

c P_ i ( $ )( e ) = 5 1 (0)-x 1 (t 1 +e), 9_ i _ n (x)(0) = - ^(0), 0 e 

[-h,0], i = 1,2,... ^n, where t, = ( . . ., £ n ) . The problem formulated 


f°*(0)]d0 

tVV 


De- 
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above is then equivalent to the problem of finding z e & such that 

cp^z) e Z Q , i = -l,-2,...,-2n, cp Q (z) < q> Q (5c) for all x with 

q>i(x) € Z Q , i = -l,...,-2n. Letting % = R 1 X JT % Q , Z = {a e R X | 
u 2n i=l 

a < °} X .1^ z 0 » and * = (<P 0 ^P 0 (3), 9_i> •••, c P_ 2n )> one has that a solu_ 

tion to this problem is a ( 4> ^ Z) extremal [47, Definition 2.2], Defining 
= & and ^’ n+1 [t o -h, t^], it is obvious that Condition 6.1 of [47 , 

p. 75] obtains. Next let f (t) = f(x ( * ),u (t),t), & = [g: 

R n+1 |g(t) = f(x ( • ),u(t),t) for some u e } and Y be the solution to 


Y(s,t) = E n+1 + / d a Y(a,t)ji(a,s) - / Y(a,t)rj(a, s)da s < t , 


(5.1) 


Y(t,t) = E n+1 , Y(s,t) =0 s > t. 


where E . is the identity in £. 

n+1 (n+^X^n+l)* 


0 0 

fta,s) =| ] , ’Tl(a,s) 

0 b(a,s) 


0 -ff(a) 

o T) (a,s) 


Define the convex set ^ by {^x e if n+1 [t -h,t ]| 5x(t) = 0, t e 

"t OX 

CVMqX 5x ( t ) = / ?(a,t)8f(a)da, t e 8f e co(J*) - f*}. Using 

the hypotheses of th2s paper, a generalized idea of quasiconvexity 
[ 1, 2, 21, 46, 47], the chattering lemma of Gamkrelidze [21, Lemma 4.1* 

2, Lemma 3.1], and reasoning similar to that of Neustadt [46, Section 3 ], 
a long and tedious argument verifies that Condition 6.2* of [47, p. 76 ] 



54 


is satisfied. For retarded systems the arguments are much like those in 
[ 1+6: see also 1, 2]. Some technical difficulties are involved for neutral 
systems, but Kent [59] has shown that these can be overcome. Finally, 
Condition 6.4 of [47] can easily be shown to hold with h = (h Q ,h ..., 
h_ 2n ) mapping into ^ given by h Q (y) = y°(t ;L ), h_ i (y)(0) = 

-y 1 (t 1 +0), h ,_ n (y)(0) = y 1 (t 1 +0), 0 e [-h,0], i = 1,2, ...,n. Thus, 

Theorem 6.2 and hence Theorem 5-1 of [47] hold. We shall show that the 
desired results follow from Theorem 5-1. 

Applying Theorem 5.1 of [47] we obtain the existence of a non-zero 
£ e such that 


(5.2) 

£(x) >0 for all x e Z 

(5.5) 

£°h(5x) <0 for all 5x e 


From the definition of we see that there are a° e R 1 and 

i = 1,2,..., 2n such that 



2n 

£((0,^, ...,l 2n ) = a°o> + Z £_ i (^ i ) 

i=l 

for every (a>, . . . ,£ 2n ) € Since =^ 1 [-h,0], it follows that 

(- 00 , 00 ) -» R^ of bounded variation, with left continuous. 


there are 
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X^(s) = 0 for s > 0, X ± constant on (-oo^-h], i = 1,2,. ..,2n such that 


0 


l ± ( 6 ) = I 

-h 


dV 0 ) g ( 0 ) 


for every i e _^’ 1 [-h,0]. Observing that (-1,0, .. .,0), (0, 1,0, . . . ,0), . . ., 

(0,0, ...,£) are in Z whenever % e Z Q we conclude from (5.2) that oP < 0 

and A,, is non-increasing, i = 1,2,..., 2n. The fact that £ is non-zero 
1 2n 

yields j a°j + Z Var( [ -h,0] j X^) >0. 
i=l 

The inequality (5-3) thus becomes 


n 0 

a°6x°(t ) + Z / dX i (e)[-6x 1 (t 1 +e)] 

i=l -h 

n 0 + . 

+ z / dX n+i ( 0 )[ 6 x 1 (t 1+ e)] < o 

i=l -h 

for all 5x e Defining X: R^~ -» R n as in statement (i) above, this 

then becomes 


(5.V) 


0 


a 8x (tj + / dX(0)5x(t +0) < 0 

1 -h i 


a a ^1 y° 

for all 6x e . The matrix solution Y in (5.1) may be written Y = ( ^ ) 

where Y°(s,t) is an n-dimensional row vector and Y(s,t) is in £ 

o 

The equations for Y ,Y are 


t t * 

Y°(s,t) = / d Y°(a,t)q(a,s) - / [- f° ( a) +y°( a, t ) tj*( a, s ) ] da 



3 6 


and 


Y(s,t) = E 


+ / 

s 


d a Y(a,t)|i(a,s) - / Y(a,t)T) (a,s)da 


for s < t with Y°(s,t), Y(s,t) vanishing for s > t. Using the defini- 
tion of Jt in (5.4) we obtain 


a 


t n 0 t +0 

O /* j_i» is nO/ \ *0 / , \ cn ft / \ t 1 . r j -\ / r\ \ r r 


'/ 1 [5f°(s)+Y°(s,t 1 )6f(s)]ds + / dk(0)[/ Y(s,t 1 +0)Sf(s)ds] < 0 


-h 


“0 


for all 


Sf in 


co^) 


f . This can be written as 


t 0 

/ 1 [a°5f°(s) + [a 0 Y°(s,t,) +/ d\(0)Y( s,t +0)} Sf( s)]ds < 0. 

*0 - h 

0 + o 

Defining i|/( s) = a°Y°(s,t ) + / d\(0)Y(s,t +0) and = <2°, an appropriate 

A “ h 

choice of 8f yields (iii). The properties of Y guaranteed by Theorem 3.1 
of Section 3 of this paper lead easily to the conclusion that is left- 
continuous and of bounded variation on [tp, 00 ) with i|/( s) =0 for s > t^. 
Using the equations for Y°, Y in the definition of t and making several 
interchanges in the orders of integration (it is here that the Borel measur- 


ability of Y becomes important - see Remark 3.1 above) which are justified 
by the Fubini type theorem in [10], we easily conclude that satisfies 
the equation in (ii). This completes the proof of Theorem 3.1. 
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We point out that the equation for \|/ in (ii) can be written in 
the equivalent form 

t + t * 

\|<(s) = -x(s-t 1 ) + / ^(©Mc^s)-/ 1 U(e)ii*(e, s)-a°f° (e)]de. 

S s 


Since X is usually only of bounded variation (BV) on [-h,0], one would 
scarcely expect \|/ to be smoother, say absolutely continuous (AC), on 
[t^-h,t^]. But for s < t^-h, the X(s-t 1 ) term is a constant (i\.(-h)) 
and one might ask whether the equation can be written in differentiated 
form (i.e., is \J/ AC?) for s e [t ,t^-h]. Even for simple neutral systems 
is not in general AC. For example if the system in the problem has the 
form (2.J) the equation for \|/ becomes 


*(s) = -k(s-t_ L ) - / dt(e)A(e) + / \lr(0)C(e)dS 

s+h s+h 


t _ * 

+ / i ['t'(0)B(0) + a°f° (0)]d0 

„ X 


and it is easily seen that \|/ has jump discontinuities at s = t-^-h, 
t^-2h, t 1 ~3h,... . However for problems involving system (2.4) the \|r 
equation is 

"t. t * 

'l'(s) = -\(s-t ) + / -S|r(0)c(0)d0 + / ± [\l/(0)B(0)4a°f° (0)]d0 

s+h s X 

and \J/ is readily seen to be AC on [t ,t -h] satisfying a.e. 



ijr(s) = -a°f°*(s) - \(r(s)B(s) - \|/( s+h)C( s+h) . 


In fact there are a number of types of retarded systems for which the cor- 
responding \|t will be AC on [t jt^-h]. These are discussed on p. 15-l6 
of [2], Note that for retarded systems the associated equation is the 
same as the X equation of (i) of Theorem 1 in [2, p. 3] with the exception 

of the ^(s-t^) term which will be constant for s < t^-h. 

If, instead of £ e ^f n [-h,0], one only specifies q components 
(q < n) of x on [t-^-h, t ], then one can derive the corresponding nec- 
essary conditions as above by using 2q of the cp ^ constraint functions 
instead of 2n. The ideas for use of the "conflict" constraints cp_^ evolved 
from trying to treat the terminal conditions in j^ n [-h,0] as some type of 
bounded state variable restraint. It is not surprising then that in a 
number of examples [ 39 ] > the multiplier X behaves much like the multipliers 
obtained in considering bounded state variable problems [ 8 , 48 ], That is, X 
has jumps at t^-h,t^ (the points at which the trajectory enters and leaves 
the "boundary" £ of the restraint region), and has jumps at points where 

the trajectory follows the "boundary" across a point where it is not smooth. 

The multiplier X can also be interpreted as a terminal boundary condition 
in function space [ 36 , 38] which usually results from transversality condi- 
tions. 

Let us mention briefly other ways of deriving the necessary con- 
ditions of Theorem 5.1. First, various other types of "conflicting" con- 
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straints [39] will yield essentially the same theorem; also it is possible 

to use a constraint of the form <p , (x) = |x -£| -0 (an 0-ball about £ 

-1 t x 

in %? n [-h,0]) together with Theorem 5®1 of [47]® Allowing £ -» 0 and 
using the linear " subfunctionals" A of that theorem yield (formally) the 
same necessary conditions as derived above. All of these proofs yield 
necessary conditions that have a notable deficiency. Observe that for the 
maximum principle (iii) to be nontrivial, one needs ct° or X or both non- 
zero. The non-zero statement involving l in the proof (see also (i) 
of the theorem) does not guarantee this. In fact, nothing rules out the 
situation a° = 0 and X. = X . , i = 1, 2, ...,n, in which case the in- 
equality in (iii) is trivially true with = 0, a° = 0. This difficulty 
also appears in the approach employing Theorem 5-1 of [47] mentioned above 
(there is no guarantee that A / 0). Nonetheless, as we shall see, the 
conditions of Theorem 5.1 above are non-trivial in numerous examples [39] 
and are actually sufficient for linear problems with certain payoffs when 
a° / 0 (normality). Thus we do obtain conditions which are both necessary 
and sufficient for a non-empty class of normal problems. 

There are derivations of the necessary conditions presented here 
which for special problems do yield a° ^ 0 (and hence nontriviality and 
sufficiency). The authors have shown that using an attainable sets approach 
[42] in function space for linear retarded systems with integral quadratic 
payoff and % = 1^, necessary conditions which are the same as those of 
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Theorem 5-1 can be obtained. Jacobs and Kao [3 6 , 38 ] have obtained equi- 
valent necessary conditions for problems with general nonlinear retarded 
systems by employing an abstract Lagrange Multiplier Rule [43, p. 243] in 
the function space But both of these latter approaches are for un- 

constrained controls and require more restrictive hypotheses than are de- 
sirable (roughly speaking, the matrix D(t), where k(u(t),t) = D(t)u(t), 
has rank n for a. e. t) . 

We next exhibit a class of problems for which the necessary con- 
ditions derived above are also sufficient. Let f°(z, u, t) = g°(z,t) + 

t 

k (u,t) and f(x( • ), u, t) = / d T](t, s)x(s) + k(u, t) satisfy the hypotheses 

t -h S 

given preceding Theorem 5-1 where T] is as in (3.4). In addition assume 
o n 

that g : R x [t ,t^] -* R is convex in z for each fixed t e [t^t^]. 
Under these hypotheses we have the following sufficiency results. 

-ft -ft 

Theorem 3.2 . Suppose (x ,u ) satisfy the conditions of Theorem 5.1 with 

00 . * *. 

\|/ = a <0. Then (x ,u ) are optimal. 


Proof : Let v e be such that the corresponding trajectory x = x(v) 

. * 

satisfies x = Cl = x + • Then from the equations for x,x* we have 
*1 \ 


I-. ( * t 

0=f d\|/(s)J[x(s)-x ( s) ] - / d p(s,e)[x(0)-x (0)] 

t_ ' t 

+ + 0 

s t * S * ) 

- / / d T](a,0)[x(e)-x (0) ]da - / [k(v(a),a)-k(u (cr),a)]da> 

t„ ) 
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Thus, using the definition of x we obtain 


-a 


:°[x°*(t..)-x 0 (t J] = a°f 1 [g°(x(s),s)-g°(x*(s),s)]ds 


"0 


+ a°f 1 [k°(v(s),s) - k°(u (s),s)]ds 


t* t + 


+ / 1 dij/(s)[x(s)-x*(s)] - / 1 dt( s)/ "'"d (i( s, 0) [ x( 0) -x (0)] 


? + 

t, s t. 


*0 *0 


- I 1 W(s)[J J 1 d fl t](a,0)[x(0)-x (0)]da) 
t. 


0 


*0 *0 


t, S * 

- / d\|»(s )/ [k(v(cr),cr)-k(u (a),a)]dcx. 


t 0 *0 


Adding and subtracting a term involving g° ( s) = g°(x (s),s), integrating by 

X X 

parts in the last two terms, and noting that i|r(t*) » 0, we find 


-a°[x° (t 1 )-x°(t 1 )] = a°J 1 {g°(x(s),s)-g°(x*(s),s)-g° ( s)[x( s)-x.*( s) ]}ds 


"0 


+ J 1 |a°[ k°( v( s) , s) -k°( u*( s) , s) ] + \|/( s)[k(v(s), s)-k(u*( s), s)]| ds 


t 

r 

b o 

t: 

f - 
b o 


t + 1 1 


+ J 1 di|<( s)[x( s)-x*( s) ] - / 1 ai(s)J 1 d fl h(s,0)[x(0)-x*(0)] 

t. 


*0 *0 


t, s * 

+ / l(s)j d T](s,0)[x(0)-x (e)]ds 

t t 8 

0 0 

+ cc°f 1 g°*(s)[x(s)-x*(s)]ds. 

t 

t 0 
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Using the Fubini type theorem [10] to interchange the order of integration 
in several of the integrals and combining terms, we have 


-a°[ x°*( t ) -x°( t ) ] = a°/ 1 (g°(x(s),s)-g°(x*(s),s)-g°*(s)[x(s)-x*(s)]}d 


0 


v *, 


+ / 1 +(s)[f(x*(.),v(s),s) - f(x"(-),u“(s),s)]ds 


0 + 

+ / 1 d 0 j\l/(e)-/ 1 di|/(s)n(s,0)+/ 1 \J/(s)Ti(s,e)ds-/ 1 a°&£ t ( s)dsj [ x.( 0) -x*( 0) ] 

t o t o t o 9 

+ 


Noting that / 1 diKs)p(s,0) = / 1 dil/(s)p( s, 0) and / i|/(s)T)(s,0)ds = 

*0 9 "o 

/ 1 \|/( s)r]( s,a)ds, it follows from the convexity assumption on g° and parts 
0 

(ii) and (iii) of Theorem 5.1 that 


-a°[ x°*( t^) -x°( t L ) ] < / ^gXCe-t^CxCej-x^e)] 


u 0 


= / 1 d 0 ^(0-'t 1 )[x(0)-x*(0)] 


t l' h 


= 0, 


or since a° < 0, [x° (t^)-x°(t^)] < 0. Thus (x ,u ) is optimal. 

The underlying idea for this sufficiency proof can be traced at 
least as far back as a paper by Rozonoer [50]. A number of other authors 
[20, 22, 4l, 42] have used and refined it. In fact, in a recent work of 
Funk and Gilbert [20] it is pointed out that under normality and certain 
convexity assumptions, the abstract necessary conditions derived by Neustadt 
[46 , 47] are also sufficient in a number of situations. 
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Section 6 . E xamples . 

We first present two examples which illustrate use of some of the 
results obtained above. 

Example 6.1. Consider a system described by the scalar equation 

x(t) = x(t) - x(t-l) + u(t). 


We wish to drive from the initial function cp = 0 
given by £(0) = 2+8, 8 e [-1,0], while minimizing 
subject to U = [-1,1]. 


to the target function 

3 

j(u) = / x(t)dt 
0 


Since f° = x, the maximum condition of Theorem 5.1 reduces to 


/ 1'(s)u(s)ds < / i|/(s)u (s)ds. 

0 0 

Thus u (s) = sgn[\|/(s)] whenever i|/(s) £ 0. The equation for t reduces 
to 


t(s) = -x(s-3) + / t(e)(-i)ae + f [*(e)(i)+a°]de, s e [0,3]. 
s+l s 

From the discussion and examples of Section 4, we guess that u is not 

bang-bang on [2,3], Thus we try t = 0 on (2,3] and a° = -1. On (2,3] 


the equation for becomes 
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3 

0 = -X(s-3) + / (-l)d0, so 

s 

\( 9 ) = 0 for 0 e (-1,0]. 

On [1,2] we differentiate the equation for i)/ and obtain 

ijf(s) = -\|/( s) -o; 0 = -\j/(s)+l. 

Thus ¥( s) = ce“^ S_2 Ul on [1,2]. But \|f(2) = -\(-l) + / (-l)d0 = -l(-l)-l, 

2 

so c+1 = -l-\(-l). Let v = -X(-l)] then c = v-2, and 

\[/(s) = (v-2)e^ 2 S ^+l, s e [1,2]. 

Similarly, on [0,1] ^(0) = -t(0) + i}/(0+l)+l. Integrating from 1) = 

(v-2)e+l, we obtain 

]/(0) = (v-2){e^ 2 ~ 0 ^-(l-0)e^ 1 " 0 h+2-e^ 1 ' 0 \ 0 e [0,1]. 

2 

We claim \|/(o) < 0. Suppose i|/(o) > 0. Then (v-2)[e -e]+2-e > 0, or 

(v-2) > e l ' 2 • > 0. Thus \|/(s) = (v-2)e^ 2-s ^+l > 1 for se[l,2], 
e -e 

i(0) > -i|/(0)+l+l = -i|f(0)+2 for 0 e [0,1]. Hence if i|/(0) >0, then 

'l'(s) >0 on (0,2), and u (s) = +1 for s e (0,2). A simple integration 

*/ \ 

shows that this implies x (2) > 1, contradicting the boundary condition 
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x(2) = 1 and proving the claim. We next claim that i|/(l) > 0. Suppose 
\|r(l) < 0. Then (v-2)e+l < 0, or v-2 < - For 0 e (0,1), 

+(0) = (v-2)[e^ 1 " 0 ^e+e-l}]+2-e^ 1 ' 0 ^ 

< -e -1 [e^ 1 " 0 ^{e+0-l}]+2-e^ 1 " 0 ^ 

= -e 0 {e+0-l+e)+2 = -e 0 {2e+0-l}+2. 

This expression has its maximum over [0,1] at 0=1, 

\|f(l). < -e" 1 {2e 1 }+2 = 0, 

and hence i)/(0) <0 for 0 e (0, 1). For s e (1,2), 

i( s) = -\[/(s)+l = -(v-2)e^ 2 

^ -1 (2-s) ( 1— s) ^ . 

> e e' ' = e v y > 0. 

Thus i i has at most one zero in [1,21. If the^e is no zero in [1,2], 

u (s) = -1 for all s e (0,2), and a simple integration shows that the res- 

*/ V 

ponse to such a control does not satisfy x (2) = 1. If \|f has a zero at 

oo e [1,2], then u* is given on (0,2) by 


ke 


As) 


-l } S € (0,cn), 

+1, S € ((JQ,2). 


Another integration shows that the response to such a control also can not 
satisfy x*(2) = 1, Thus 1/(1) >0 must hold. 

From 1/(1) >0 it follows that (v-Sje^+l > 0, or (v~2)e 1 > ~1. 

On (1,2) 

y(s) = (v-2)e^ 2 ' S Ul = (v-^eM 1 '^! 


so t( s ) >0 for s e (1,2). On (0, 1), 

1/(0) * -f($) + 1/(0+l)+l > -t(0)+ 1. 

Thus we have that \|/ has at most one zero in (0,1). Since i|/ is continuous 
with 1/(0) < 0 and 1/(1) > 0, f has a zero in (0,1), which we denote by o>. 
This implies the optimal control is given by 

* ( s e (OjU)), 

u (s) « / 

(+1, s e (oo,2). 


The response to this control is 
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x (t) 


(t-Oo) t 

2e x -e -1 

_ (t-oo) t oN (t-1) 
2e v '-e +(t-2)e v ’ 

_ (t-oo) t , x (t-1) 
2e v -e +(t-2)e v 


, t e [0,do] 

, t e [oo, 1] 

, t 6 [ 1, 1 +Cd] 

-2(t-2-oo)e^ t " 1 ~^-2, t € [ 1 +od, 2 ] . 


From the boundary conditions 


l-x*(2) = 2e^ 2 "^-e 2 +2ooe^ 1 “^-2 

x (l-oo) 2 

2(e-hn)e' ' - 3+e 

, x ( l-oo) 1/ , 2> 

( e+oo)e' ’ = ~{3+e ). 


The solution is approximately co = 0.551. To determine v we go back to 
the equation \|/(oo) =0. 


(v-2)(e< 2 - JJ ).(He( 1 ^)*S-e (M - 0 


v = 2 


2-e^ 1 ~ oi ) 


<V/ 


2-0. Ill 


1.889. 


We determine u on (2,3) by using the equation for x and the fact 
that x(s) = s— 1, s e (2,3). On (2,3), 1 = s-1 - x(s-l) + u (s), u ( s) = 
2-s + x(s-l), from which it follows that 


/ 2-s+2e^ s ^ ^ -e^ S "^ +( s-3) S ” 2 ^ , s e (2,2+co) 

\ -s+2e^ S " 1_(D ) - J S_1 ) +( s-3) S “ 2 ^ -2( s-3-oo) e^ S “ 2-a ^ , 


s e (2 -kd,3). 
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Since j u | < 1 this is an admissible control satisfying the necessary con- 

O f * 

ditions with a f 0, and by Theorem 5.2 u is an optimal control. It is 

■X- 

not difficult to argue that u is in fact the unique optimal control. 
Example 6.2 . Consider a system described by the scalar equation 

x(t) = x(t-l) + u(t). 


We wish to drive from the initial function cp = 0 to the target function 
given by 


5(e) 


e, e 6 [- 1 ,- |], 

1 + 0, e e [. |,Q], 


3 2 

while minimizing J(u) = / u (t)dt 

0 


subject to 



The maximum condition of theorem 5.1 reduces to 


a. °[v 2 -u* 2 (s)] + t(s)[v-u*(s)] < 0 

for all v e R 1 , almost all s e [0,5]. Let us choose a° = -1. Then this 
implies 


U*( s) = \ +( s) . 



The equation for i| / reduces to 


U9 


l(/(s) = ^(s+l) - \(s-3), S £ [0,3], 


hence we have that 


u*(s) = u*( s+1) - for s £ (0,2) . 


From the shape of the target, the equations, and this relationship between 

-X- 

u (s) and u (s+l), we guess that the optimal trajectory is composed of 
straight line segments of time-length Let the slopes of these be a, 

P, r, S respectively on [0,2], and set - ^ X(-l) = K. Thus 


u*(s) 



r-a , 
5-p , 


-i ~r , 


S £ (0, ~) 

S e (|,1) 

S € (1, |) 

S € (|> 2) 

s e (2, |) 

s e (|, 3). 


Substituting these in u ( s) = u (s+l)+K, we obtain the systems of equations 


S-P = 1-6 + k, p-a = -1-r + K 


P = 5-p + k , 


a = p-a + k 
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Solving in pairs; p = 25-1-fC and 8 = 2p-K imply p = 4p-2/c-l-K, or 3P = 

1 2 

3k+ 1. Thus p = k + ^ , 8 = k + r^. Also a = 2y-K+l and y = 2a - k imply 

1 2 

a = 4a-2/c+l-/ , c, or 3a = 3^-1. Thus a - K - ^ } y = /c - j. The endpoint 

* 1 XX 

x (2) = — is half the sum of the slopes, so ^ = ^(a+p+y+S), 1 = 4/c, or 

X X 7 5 XX * 

K = ] Thus a = - p = ~ f r = - j2> an<3 & = 22 * From u ( s ) = 

1 * 

4(s) and the expression for u in terms of a, p, y, and 8 we obtain 

s e (0, |) 
s e (|, 1) 
s e (!, |) 
s e (§, 2 ) 
s € (2, |) 
s € (§, 5). 

This ij/ satisfies the equation in Theorem 5.1 with 


+(s) = J 


1 

- E * 

7 

E ' 
4 

" E ’ 

4 

E ' 

7 

" E ' 

l 

E ' 



x(e)= i 


7 

E> 

l 



9 e (-«>,-l] 

0 6 (-1,- |] 

0 e (- §, 0] 


0 e (0,«>). 
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The x , u obtained here satisfy the necessary conditions with \|/ and \ 

o * 

given above and a = -1. By Theorem 5.2, u is optimal. Since the system 

equations are linear and f° is strictly convex in u, standard arguments 

1 * 

[42] show that u is unique. 

There are several ways in which one could attempt to solve fixed 

function target problems without using the necessary conditions for driving 

tf-h Q 

to a function. The most direct is to minimize / f (x( s),u( s), s)ds 

t 

* 0 

while driving to x (t.-h), and then attempt to determine u on (t^-h,t^) 

* O/ 

so that x is as desired. If f (x,u, s) is independent of u for s e 
*1 m 

(t-^-hjt^) and U = R, this approach can succeed provided that given x on 

[tQ-hjt^] one can solve the system equations for u(s), s e (t^-h,t^). 

/in * * 

If U p R the method may fail because the u determined on (t-^-h,^) 

in this manner need not lie in U; in the case of example 6.1 it succeeds. 

In fact, given the assumption that 'i'(s) =0 for s e (t^-h^t^] in Example 

6.1 the subsequent arguments are identical to those resulting from applying 

the maximum principle for point-target problems [2, to] as suggested above. 

If f°(x, u, s) is not independent of u for s e (t-^-h,^) this approach 

will generally fail. In example 6.2, driving to x(2) = i while minimizing 
2 2 

/ u (t)dt yields 
0 


u*(s) 



s e (0,1) 
s e (1,2), 


x*(t) 


, t e [0, 1] 
t e [1,2], 


which is not even close to the optimal trajectory for the function target 
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problem. 

A more complicated method involves making the function-target prob- 
lem equivalent to a point-target problem by altering the form of f° on 
[t ,t -h] to include the "cost" due to the u determined on (t^-h^t^) as 
above. With U = R™ one may then use either the necessary conditions of 
the calculus of variations (see [ l6, 34, 51 ]) or the point-target maximum 
principle. Examples illustrating this can be found in [391* I n example 
6.2, the altered cost-functional is 

1 3/2 

J( u) = / u 2 (t)dt + / (u 2 (t) +[ -l-u(t) -u(t-l) ] 2 )dt 

0 1 

2 2 2 
+ / (u (t) +[ l-u( t) -u( t-1) ] )dt 

3/2 

1 2 5/2 2 2 

= / x ( t) dt + / ([x(t)-x(t-l)] +[-l-x(t)] }dt 

0 1 

2 2 2 

+ / {[*(t)-x(t-l)] + [l-x(t)] }dt. 

3/2 

With this form of J(u) in terms of u, one clearly would prefer not to use 
the maximum principle on this equivalent problem. Applying the modified 
Euler conditions to the second expression for j(u), one obtains that the 
optimal trajectory must consist of line segments of time-length l/2. How- 
ever, the relationships between the four slopes and a single constant are 
not obtained, and the problem of determining the slopes remains difficult 
without the function-target necessary conditions. When U / R m the 
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problems encountered in the first point-target method will also occur here. 
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